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'sj- i In this article a tool for the analysis of population-based EAs is used to 

I derive asymptotic upper bounds on the optimization time of the algorithm 

solving Royal Roads problem, a test function with plateaus of fitness. In 
addition to this, limiting distribution of a certain subset of the population is 
approximated. 



1 Introduction 

Since early 90s a large amount of theoretical analysis of EA has evolved, both in 
convergence (rate of improvement) and runtime (expected optimization time). Most 
research in EA community so far has been focused on single-species (i.e. (1 + l)EAs 
with some form of mutation). EAs with nontrivial size of the population and/or the 
recombination pool were analyzed in |HY02t[HY03] (population-based algorithms) 
|CHS"'"09[ICTCYlTj (evolution of the is driven by the accumulation of a special type 
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of species, locally-optimal individuals (LOIs), rather than the probability of find- 
ing a better fit species), |Witn6[IWitn8] (tree-based analysis), |TSMllb[lTSMllaj 
(population-based EAs for Royal Roads (RR) test problem and 1-Bit-Swap opera- 
tor). 

One of the main questions that these findings tried to answer, was, if the effect 
of the population was positive. It was found, that, if measured in the number of 
function evaluations rather than generations, for easy problems with a large (0(n!)) 
number of paths, population degrades performance. In |HY04j {n+n)EA with recom- 
bination, mutation and selection solves OneMax in O(n^) if measured in the number 
of function evaluations vs G(nlogn) by (1 + 1)EA. This means a population-based 
algorithm boosts performance only on parallel computers, i.e. if the fitness is com- 
puted on parallel computers simultaneously. 

Later in |CHS+09j it was shown that when measured in the number of function 
evaluations, asymptotic order of population-based EAs compared to (1 -|- 1)EA are 
no worse only for population size 0(1) (for problems like OneMax and Leading Ones). 
An advantage may come from the point of view of diversity, reducing the risk of bad 
initialization and the probability of finding a solution eventually (convergence prob- 
ability) . 



Most of the research on population-based algorithms uses two tools to derive runtime: 

1. Drift analysis. It was introduced in |HY01] and widely applied to both single- 
species (see i.e. |D JWlObllD JWl l| Jag08] etc) as well as population-based EAs 



[I.e. |,TD,TWn5[l( )HYn8llN( )Wn9j ) . Drift is a form of a martingale functions that 
is widely used in other areas of science (e.g. quantitative analysis, physics, etc) 
to bound the difference in change of a stochastic process (see e.g. |Haj82| ) 

2. Family Trees. It was first introduced in EA community in |Wit06j and is based 
on bounding the distance of an offspring from the ancestor generated randomly 
at the start of an algorithm after a number of generations. 

Most of the analysis (except jHY02l[HY03llCHS+09llCTCYllllTSMllbllTSMllap 
was focused on either or (1 + A) algorithms. Naturally, the question arises, 

if the results for these two can be extended to a. {/i + X). The answer is probably 
no, as the result, in, e.g. |CHS"'"09j for (A^ -|- A)EA is (if measured in the number 
of function evaluations) 0{nN log N + nlogn). It cannot be directly derived from 
combining the results for (/i + 1) in, e.g. |Wit06] and (1 + A) in [HelOj . 
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Another issue is that in most of these papers population or recombination pool 
were considered 'monolithic', i.e. species with different fitness were never considered 
separately. The disadvantage of this approach is obvious: the evolution of the popu- 
lation 'on the whole' is determined by the evolution of its subsets, and not just one 
type of species (e.g. currently best). Therefore runtime (optimization time) bounds 
can vary substantially by analyzing different subsets of the population. 

In Section [2] we explain in details the motivation for the development of the of the 
new approach to the analysis of population-based algorithms. In Section [3] details 
of the analyzed algorithm and the problem are given. In Section H] Elitism Levels 
Traverse Mechanism is presented. In Section [5] the birth-and-death Markov Chain 
for the runtime is derived. In Section [6] main results of this art ice are presented, 
i.e. the upper bounds on the runtime of the algorithm derived using the Elitism 
Levels Traverse Mechanism. In Section [7] we approximate the stationary distribution 
of super-elite species in the population. Section |8] concludes. 

2 Complexity of Analysis and Approach 

In Section [1] we outlined some of the drawbacks of the current approach to the anal- 
ysis of (// + A)EAs. Here we give a more detailed motivation for the development of 
an analytical tool suited for these algorithms. 

It may seem strange that (// + A) algorithms (with both /i and A > 1), despite their 
widespread application in real life are less popular in theoretical EA community than 
(1 + 1), some of them outlined in the previous Section. One of the main reason is the 
complexity of the structure of the population. Throughout the run of the algorithm 
both population and recombination pools consist of different types of species with 
different fitnesses. If a genetic operator that recombines information between parents 
is used, then pairs of parents have to be considered rather than single species. Quite 
obviously the structure and prevalence of certain types of species in the population 
affects greatly the dynamics of the evolutionary process. 

More specifically, the complexity arising from the structure of the population re- 
sults in the following issues: 

1. Distribution of species of different types in the population. This is probably 
the most obvious consequence of using fj, > 1. Regardless of the problem con- 
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sidered (even with traps and/or local minima), species with different fitness 
do not have equal representation in the population. Among other things, it 
is important to distinguish species with currently best fitness (elite) and the 
rest, especially for functions with plateaus. To the best of my knowledge, this 
quite obvious and important fact has never attracted much interest in EA com- 
munity, most likely due to the complexity of the combinatorial structures of 
these subsets of the population. Interesting though,it is well-known in biology, 
epidemiology and related areas. 

2. Fitness-proportional selection. This selection is one of the most important fea- 
tures of EAs. Obviously, it defines the structure of recombination pool, and 
depends on the distribution of species in the population. If a certain type of 
species dominates the population, they may be underrepresented in the recom- 
bination pool due to low fitness. Thus, depending on the type of the problem 
(e.g. with multiple optima), it may greatly inhibit the evolutionary process. 
At the same time, currently best (or next-best) species, even though they need 
not be abundant in the population, have a high probability of expanding their 
presence in the recombination pool. This issue was touched upon in |CHS+09j . 
where the number of elite species in the recombination pool was found to ex- 
ceed that in the population by at least 25%. The selection process for any 
selection type was simplified to the proportion of LOI in the population and 
ignoring the upgrade of non-LOI to LOI. One can suspect that different se- 
lection functions lead to different structures of recombination pools and thus 
variance in the probability of generating better offsprings. 

3. Pairing of parents. This point is valid for algorithms with recombination opera- 
tors, e.g. crossover. The number of types of pairs greatly affects the probability 
of evolving higher-ranked offsprings and their structure. If the algorithm uses 
recombination pool size A, there are | pairs. Even for a simple case when the 
population has only two types of species, a and /3, there are three types of pairs: 
< a,a >, < a,/3 > (or < /3,a >) and < (3,/3 >, each with its own properties 
and evolution probabilities that can differ to a greater degree than an order of 
a constant. Even in this simple case there are, using multinomial coefficients 

^j=o^r=o (f) i^r'') ~ ^ possible combinations of pairs of parents in the 
recombination pool. 
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4. Exchange of genetic information between parents in the recombination pooL 
This point is also vahd for algorithms with recombination operators. The ma- 
jority of publications that consider populations with crossover (e.g. |OHY08] ) 
only a simple lower bounds on the probability to improve fitness on each fitness 
level using crossover is considered, although the probability of success can vary 
substantially between different types of parents. Even if the analysis of differ- 
ent pairs of parents does not improve the asymptotic runtime result, it may 
shed light on some properties of the recombination process and the efficiency of 
EA, since it is hypothesized that EAs' performance is driven by recombination 
rather than mutation. 

5. Distribution of offsprings and genetic (fitness) progress. Finally, little is known 
about the results of recombining genetic information, more specifically, the 
distribution of offsprings and the replacement of old population. Usually, as 
m |CHS+n9j the best jj species is selected from fi + X parents and offsprings. 
Depending on how 'progress' is defined: generation of one, at least one, or 
some specific number /proportion of better offsprings, it can lead to very dif- 
ferent bounds on runtime. 

Although many of these issues are known in theoretical EA community, they are 
usually overly simplified or avoided altogether. The main contribution of this article 
is the development of a new approach that allows to answer some of these questions. 

3 Algorithm and the Test Function 

The algorithm analyzed here uses the simplest variant of K-Bit-Swap operator in- 
troduced in |TSMH10] with K = 1. It is a recombination operator that transfers 
information between two parents and has some features of both uniform crossover 
and mutation. 

The only test problem considered in this article is Royal Roads, a test function 
with plateaus of fitness. It was introduced and discussed in |MFH92llMit96j and in- 
stances of it were analyzed in |WJ07llSW03] . A more general non-modular problem 
was also considered in |Rud98] . 

The feature that makes this type of problems quite hard for EA (originally they 
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were designed to test DA's ability to recombine schemata, see |Mit96] ) is the lack 
of guidance towards the global optimum, although unlike, e.g. TwoMax problem is 
does not have 'traps' that lead the algorithm into local optimum. 

3.1 Algorithm 

Below are Tables [T], [2], [3] with pseudocode for a + A) Evolutionary algorithm using 
a variant of Tournament selection with a 1-Bit-Swap (IBS) genetic operator. For 
more details on IBS see [TSMHlOj . 



Table 1: + A) Evolutionary Algorithm using 1-Bit-Swap 



1 


create /x starting species at random 


2 


t = 




loop until the solution is found 


4 


select using a variant of fitness-proportional Tournament selection 




1 pairs of parents into the pool 


5 


swap bits in each pair using IBS 


6 


keep the currently-elite species in the population, replace the rest 




with the pool, first with new currently-elite, then at random 


7 


t = t + l 


8 


end loop 




Table 2: Variant of Tournament Selection 




1 k = 




2 loop over the size the pool 




3 select two species from the population at random 




4 examine their fitness, the better one enters the pool 




5 k=k+l 




6 end loop 



3.2 Test problem 

Our notation is somewhat different to that in |Mit96] . but otherwise we follow the 
idea or the Royal Roads (RR) function quite closely. We consider a string of binary 
values length n which is divided into K disjoint subsets (bins) length M each s.t. 
n = KM. Although RR directly implies that the bins are consecutive, since we do 
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Table 3: 1-Bit-Swap Operator 

1 J=0 

2 loop over the number of pairs in the pool 

3 select a bit in the first parent uniformly at random 

4 select a bit in the second parent uniformly at random 

5 swap these bits between parents 

5 j=j+l 

6 end loop 



not use segment or uniform crossover, they need not be such. We denote x^j the 
value of the j'th bit in the k'th bin in string s. Therefore objective function of the 
string s 

K-l M-l 

fis) = '^CkYl ^k,j (1) 
A:=0 j=0 

w.l.o.g. we set Ck = M ^ k. Quite obviously the unique global maximum of fitness 
is then of course n. The most complicated feature of the problem is the fitness- 
proportional selection function that does not differentiate between species in the 
population if their fitness is the the same, i.e. species on the plateau of fitness. 
It is obvious though from Equation [T] that we need to somehow distinguish between 
strings of the same fitness kM but different distance to the next fitness level {k+l)M. 

This problem is taken care of by introducing the auxiliary function, OneMax that 
simply sums the number of 1-bits in each bin. In essence, this allows to track the 
progress of currently-elite species to the next fitness plateau. 

The second distinct feature of the algorithm analyzed here is that the offspring can 
either have -1, or 1 more 1-bit anywhere after swapping. This means that it is 
impossible that 2 bins evolve simultaneously. In other words, bins in the population 
evolve in some arbitrary sequence (obviously there are K\ such sequences). There- 
fore, we can ignore progress in other bins and only look at the evolution at some 
arbitrary A;'th bin that we refer to as active. 

We are now ready to discuss the new approach we have developed. 
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4 Elitism Levels Traverse Mechanism 



This new approach uses some previously-known ideas, such as artificial fitness levels 
(see |JW01] ) and locally-optimal individuals (see |CHS"'"09] ). This approach ad- 
dresses some of the main problems revealed in Section [2] and suggests a different way 
to derive the upper bound on the mean first hitting time of the global solution. Its 
main features are: 

1. Identification of the possible ways of adding elite species that can improve the 
fitness of the population. These ways are combined into the probability of a 
successful event 

2. Elimination of any assumptions of the distribution of species in the population 
that make enables derivation of sharper runtime bounds 

3. Instead of finding the probability of advancing a level of fitness, it works by 
finding the probability of advancing a level of elitism, e.g. adding an elite 
species up to a certain proportion 5 that ensures the 1 — o(l) probability of 
evolution 

The working of the Elitism Levels Traverse Mechanism can be illustrated by an ex- 
ample from immunology. 

Suppose that there exists a population of species of size A^, which is susceptible 
to M types of infection, which are mutually exclusive, i.e. a species cannot be in- 
fected by more than one infection at the same time. The size of each set of infected 
species cannot be larger than rrij. We denote an event that there are 1 < r < nij 
infected species of type 1 < j < M that can infect exactly one healthy member of 
the population by E*. Since the sets of infected species are mutually exclusive, by 
additivity the probability that a healthy species get any of the infections is obtained: 

U ^; = ^ U U = 5Z E ^(^;) = E ^(^;) = ^(^*) 

jr=l ^ Vj=lr=l ^ j=l r=l 3=X 

This expression needs to be simplified for a number of reasons, e.g. the knowledge 
of vfij. Although one can find bounds on the partial sum of rows of Pascal triangle 
(since nij is clearly less than A^), it is guaranteed to make the derivation messy. This 
is done by considering only one infected species of each type rather than r and the 
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event of infecting exactly one healthy species with any of M viruses is therefore Ej. 
This yields the lower bound on the total probability of adding exactly one infected 
offspring: 

M M 

P{E*) = J2 PiE*) > nE,) = P{E) (2) 
3=1 i=i 

The proof of Equation [2] is in |TS12] . Obviously, this inequality becomes strict if 
there are at least two infected species with at least one type of infection 

Expressing these ideas in the notation and language of EA, infected species are 
elite, M is the number of ways to generate elite offsprings, N = ^, the number of 
pairs in the recombination pool. Thus, the probability above given a elite species 
and k'th fitness level, becomes P{a, k). We need to find the time until there are 6n 
elite species in the population, which ensures the 1 — o(l) probability of advancing 
to the next fitness level. If there are at most n such levels, the upper bound on the 
runtime of the algorithm is 

Derivation of the upper bound from Equation [3] is rather versatile. One needs to 
identify pairs of possible parents < Pi,P2 > such that there exists some strictly pos- 
itive probability of swapping (or otherwise exchanging) bits Lp{k) that, as a results, 
at most one new elite offspring evolves. Nevertheless, as explained in Section 121 the 
fitness-proportional selection function does not differentiate between species on the 
plateau of fitness. 

As a result. Equation E] cannot be directly applied to the Royal Roads test func- 
tion, since elite species have different distance to the next fitness level, and some 
of the elite species can degrade due to random walk on the plateau. In the next 
subsection we give more details on the application of the Elitism Levels Traverse 
Mechanism to the Royal Roads test function. 

4.1 Structure of the population (partition of the levels of 
elitism) 

Both the Elitism Levels Traverse Mechanism and the evolutionary process of the al- 
gorithm described in the previous subsection depend predominantly on the structure 



9 



of the population, which is discussed here. 



The run of the algorithm is divided into Phase 1 and 2. Phase 1 starts at the 
random initialization of the algorithm and ends when the first active bin is solved. 
Phase 2 starts with the second active bin and finishes when the whole problem is 
solved. The reasons for this partition are quite clear: until the first bin is solved, 
fitness function does not distinguish between species (they are all of the same fit- 
ness). After that the structure of population becomes more distinct, with elite and 
non-elite subsets. In both runs though we need to partition the elitism level, i.e. the 
level which includes only elite species by using the auxiliary function. 

Phase 1 

To obtain probabilities for this Phase, we see that if measured by fitness function, 
all species (candidate parents) have the same fitness. Therefore in this Phase we can 
distinguish them only by the auxiliary function: 

a* : species with the highest auxiliary function (closest to the next fitness level) 
(3* : species with the next-best value of the auxiliary function 
7* : the rest of the popualtion 

In jCHS+n9j it is suggested to 'wait' until population accumulates ^ currently-elite 
species and then find the probability that at least one of them evolves. We instead 
consider a certain number 6* a (in Phase 1 /i = a for the reasons pointed out above) 
of super-elite species such that the probability to evolve an offspring with higher 
auxiliary value is arbitrarily close to 1. 

Also, due to the complexity of the structures arising in the dynamics of popula- 
tions, we use a trivial lower bound on the number of (3* species, 1, and thus the 
number of 7* is simply /i — a* — 1. Since a the variant of Tournament selection 
is used, this means that if the fitness of the candidates is the same, the parent is 
selected randomly, we use the lower bound on selection probability. For example, 
the probability we use to select pair < a* , (3* > is 



Applying Elitism Levels Traverse Mechanism we find that there are four types of 
pairs that may add exactly one super-elite offspring to the population (since the 
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older super-elite species are saved due to elitism): 

< a* , [3* > : need to select at least 1-bit in the active bin in the first parent 

and a 1-bit anywhere in the second, 
on the success probability 

< a* , 7* > : need to select a 1-bit in the active bin in the first parent 

and a 1-bit anywhere in the second 

< (3* , (3* > : need to select a 0-bit in the active bin in either parent 

and a 1-bit anywhere in the the other 

< /3* , 7* > : need to select a 0-bit in the active bin of the first parent 

and 1-bit anywhere in the the other 

Therefore, we need to bound the number of 1-bits 'anywhere' or in the active bin in 
the parents. We assume pessimistically that a* has at least three 1-bits in the active 
bin, therefore /3* has two and 7* has one. This is to avoid division by 0. Also, when 
selecting 1-bit from 'anywhere' in the other parent, we consider the following: there 
are K — 1 inactive bins, in which /?* parents have at least 2{K — 1) 1-bits and 7* at 
least K — 1 bits. Hence flipping probabilities (fi . . .1^4 are: 



J 2{K-l)+j-l 

^1 = 

n n 

J K-l+j-2 

n n 

M-j + 1 2{K-l)+j-l 
(f3 = 2- 

n n 

M -J + 1 K-l + j-2 

f4 = 

n n 

Similar logic applies to the loss probability, in Phase 1 it is just 

< a*,7* > : need to select a 1-bit in the active bin in the first parent 
and a 0-bit anywhere in he second parent 

which of course leads to the degrading of the super-elite species and reduction of 
their number by 1. 

The runtime bounds for Phase 1 are derived in Subsection 16.21 and Appendix |X1 
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Phase 2 

When the first bin is solved, population structure changes, since some species be- 
come better fit than the rest. From this point on, selection function distinguishes 
between elite a, current highest fitness the rest of the population that we denote rj. 
In addition to the four types of pairs mentioned above, we get two more: 

< a* ,1] > : select a 0-bit in the active bin in the first parent and a 0-bit 

anywhere in the second parent 

< f3* ,1] > : select a 0-bit in the active bin of the first parent and a 1-bit 

anywhere in the second parent 

Later in Appendix O we show under what (quite general) conditions these two new 
types of pairs are lower-bounded by the ones defined in Phase 1. The complexity 
of this analysis comes from the fact that i] species form the majority of population 
(since a can be quite small), but we know nothing about their distribution (or make 
any specific assumptions thereof). Therefore, in the derivation of the lower bound 
in Appendix [Cl since all r/ species are worse than a, the probability to select them is 
(1 — and the simple upper bound on the number of super-elite species is a > a*. 
Then also a trivial lower bound on the probability of sampling a 1-bit anywhere in 
this type of species, 

The probability to sample a 0-bit in 77 is upper-bounded by 1 — ^. These condi- 
tions seem quite loose, but nevertheless we are able to prove the lower bounds, albeit 
with some restrictions on a proportion of the population. 

Additionally, in Phase 2 by summing of k, the number of filled bins we account 
for the fact that we can sample an increasing number of 1-bits. Combining it with 
the same assumption of the number of 1-bits in these bins, we obtain the number of 
0-bits in 7* : n - {K - 1) - k{M - 1). 

In a similar way as in Phase 1, one more type of pairs that enables loss of a super-elite 
species is 

< a* ,1] > : select a 0-bit in the active bin of the first parent 
and a 1-bit anywhere in the second parent 

The details of the derivation for Phase 2 are in Subsection 16.21 and Appendix [B] 
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Some features are common to both phases: monotonicity of probabihties (see Subsec- 
tion |6ll]) that enables us to lower-bound probabilities of adding a super-elite offspring 
to the population and an assumption that an a species cannot degrade, e.g. by re- 
placing a 1-bit with 0-bit in the bins that had already evolved. 

One important simplification we use here is that the auxiliary function of the ac- 
tive bin is non-decreasing, which amounts to saying that the number of super-elite 
species cannot drop to 0, which is especially important in the construction of the 
Markov chain in Section |5l This can be justified by considering the following case: 
if the auxiliary function degrades, the number of (3* species is at least S*a, which 
by assumption means that the a* offspring is regenerated with probability 1 — o(l). 
Similar cases are well-known in areas such as immunology and ecology. 



5 Markov chain analysis of the algorithm 

We construct on each bit in the active bin, i.e. every level of auxiliary function a 
(auxiliary) birth-and-death Markov chain (MC) with 1 absorbing state {S*a). The 
S*a X 6* a transition matrix for this MC is 



P = 



ri,i 


Pl,2 





■■ 











Q2,l 


r2,2 


P2,3 


■• 














13,2 


r3,3 


P3,4 • • 




















■■ 


<lS*a-l,5*a-2 


^S* a—l,S* a—1 


PS'a- 











•• 
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The dimensionality follows from the pessimistic assumption that each auxiliary level 
starts with only one super-elite parent. The expected first hitting time of the absorb- 
ing state from any state in the MC is expressed as a recurrent (difference) equation: 

'>TT'a*,S*a = 1 + Qa" ,a* -lITT-a* -l,5*a + 1^ a" , a* ITT' a* ,5* a + Pa* ,a*+l'>^a*+l,S*a (4) 

due to the assumption this becomes 

mi^s*a = 1 + ri,imi,5*„ + pi,2m2,5*a (5) 
with a boundary condition ms*a,5*a = 0. We define a new recurrence expression: 
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trivially this quantity is nonnegative and its telescoping sum is 



J2 ^- 



mi A* 



Q*=l 



We rewrite Equation H] (since p + q + r = 1): 

(Pa*,a*+1 + Qa*,a'--l)fna*,S*a = 1 + Qa* ,a*-l1TT'a*-l,S*a + Pa* ,a*+ima*+l,5*a 
PQ*,o*+l(^o*,<5*a ~ T^a*+l,6*a) = 1 + Qa* ,a* -l{nT-a* -1,5* a ~ f^a*,&*a) 
Pa*,a*+lMa* = 1 + Qa* ,a* -iM^* -1 

M^, = + ^^^:^M^._, (6) 

Pa*,a*+1 Pa*,a*+1 

We also rewrite Equation [5] as: 

1 

mi^5*a = \- "^2,5*a 

Pl,2 

and, therefore, 

Ml = — 

Pl,2 

Solving Equation E] recurrently, we get the expression for the general term M^* : 

_ 1 (i I C[a*,a*-1 ■ Qa*-l,a*-2 ■ ■ ■ <l2,l 

Ma* — I i H h ■ ■ ■ H 

Pa*,a*+l\ Pa*-l,a* Pa* -l,a* ' Pa* -2,a* -1 ' Pl,2 

^ / a* a*—m \ 

= —^ i + y TT (7) 

Summing on a*, the LHS is simply the desired quantity, mi^s*a- 

S*a—1 _ (5*Q— 1 _ a* a* —m 

mi,s*a= E + E E n '""'""-^ (8) 

Pa*,a*+1 Pa*,a*+1 Pa*-l-l,a*-l 

Now the RHS has to be simplified to be solved. The numerator of each fraction 
is a product of probabilities, so each of them is upper-bounded by qa*,a*-i- The 
denominator can be simplified in the following way: if the probability to increase the 
number of super-elite species grows (we prove this in Subsection 16. ip for any a* > 1, 
we can use the sequence of inequalities ps*a-i,s*a > P5*a-2,6*a-i > • • • > Pi,2 > pi*2- 
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Thus the upper bound bound on the first hitting time of 5* a super-ehte species in 
the population is 

5*a—l ^ r* S*a—1 

+ ^ (9) 

Prom this we will derive the upper bound on the mean first hitting time of the 
algorithm (each mi^s*a is also a function of the j, the number of bits set to 1 and A;, 
the current plateau of fitness: 

X-lM-l K-l M-l5*a-l ^ 

k=0 j=3 k=0 j=3 a*=l 

K-l M-1 5*a-l 

k=0 j=3 a*=2 

For simplicity we refer to the first term as the first expression and the second term 
as the second expression. 



6 Upper Bounds on the Optimization Time on the 
Royal Roads Test Function 

We start by showing the monotonicity of success probabilities that greatly simplify 
the derivation of the asymptotic upper bound. 

6.1 Monotonicity of Selection probabilities 

Earlier wc used monotonicity to upper-bound the expression in the MC. Here we 
prove this statement. We start by simplifying all swap probabilities (fii . . .<f4 — 0(1). 
We need to show 

Pa*,a*+1 ^ 
Pa*-l,a* 
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The numerator and denominator for all four types of probabilities are (since binomial 
coefficient (^j cancels out): 

_ 2a* 2a*(/i-a*-l) 1 2(/i - a* - 1) 
_2(a*-l) 2(a* - 1 2{fM - a*) 

2/x - 2a* + 2/xa* - 2a*2 - 1 , ^ , * , 
= K l>lita < — 

Pa''-i,a* "^ct* + 2^a* - 2a*2 " "2 

We show in Section 1631 that this inequahty holds with high probability, i.e. we need 
only a small number of super-elite species {S*a is independent of for A = /x) to 
produce a string with a higher value of auxiliary function. 

6.2 Upper bounds for (/i + X)'EAibs 
Phase 1 

In Phase 1 we are concerned only with the first bin, so we sum over a* and j, the 
number of bits in the first bin. 

To use Elitism Levels Traverse Mechanism, we need to identify all pairs of par- 
ents that may add exactly one super-elite string to the population. These are (as 
shown in Subsection lO) < a*,/3* >, < a*, 7* >, < /?*,/?* >, < /3*,7* >. As we 
are primarily concerned with the evolution of super-elite species, we always use the 
trivial lower bound of /3* > 1. Therefore the number of 7* species in /i — a* — 1. 

The probability of success is 




Pa*,a'+i = : -r^Vi + t;— ^ V2 + -r^Vs + 7^ ^ 



with the same notation for the probabilities of swapping bits as in the proof of 
monotonicity. The rest of the derivation is in Appendix |Al The upper bound on the 
runtime of Phase 1 is 

^ W log (^) log(M + 1) ^6MM - A)f 

1— ^ ^ _ \5*aIVI(2K+M) ^ ' 

/In? 
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Phase 2 

In this phase we are concerned with the remaining K — 1 bins in the string, so in 
addition to a* and j we also consider fc'th active bin. In addition to the four pairs 
we had in Phase 1, we also get two more: < a*,r] >, < /3*,r] >. rj is any species 
that is not in the subset of currently-elite. Since all the expressions are already quite 
messy, we try to simplify further. In Appendix Owe prove the lower bound for these 
pairs and show the conditions under which they holds. 

The expected first hitting time for Phase 2 is 
8^n2 log 6* a log K log(M + 1) 



AM 

(M -A){K - 2fX{M^ - M - 6)(3/i - 2S*a - l){6*a)^{2n -K - KM + M - 3) 



ET2 < 

+ 

(12) 

Combined runtime of the algorithm 

Combining the expressions in Equations [11] and [121 the upper bound on the expected 
first hitting time for the whole algorithm is obtained: 

Er = ET, + ET, < ^^""^ + ' " 



\^ ' ^ _ X5*aM(2K+M) 
-L 9 



^ 8/2^2 log 5*a log K log(M + 1 



+ 



AM 

(M -4){K- 2f\{M^ -M -Q){3fi- 26*a - l){6*af 

XS*aM{2K+M) 



2n- K - KM + M - 3 



(13) 



n 



Equation [13] looks quite cumbersome, but it can be reduced by setting K = M 
and taking 5* a = 0(1) as for OneMax in |TS12j : 

Er < ■ 0(1) + n ■ 0(1) + " ■ 0(1) + ^ ■ 0(1) 

A A /u 

= 0(^^!^i^) (14) 
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or, measured in the number of function evaluations, 



Er = 0(/in2 log^n) (15) 

Comparing this result to similar in literature, including 2^ log ri in |Mit96j and 
O(n^) in |SW03j . it is easy to notice that {fi + X)EAiBs outperforms other algorithms. 
Another interesting point is that the asymptotic runtime for Phase 2 is larger than 
the one for Phase 1 only by O(logn). 

6.3 Proof of the upper bound of the number of super-ehte 
species (the lower bound of the probabiUty of evolution) 

In the previous subsection the derivation of the runtime was based on the assump- 
tion that S*a = 0(1), i.e. some constant c that does not depend on a or ^. Here 
the bound on the probability to evolve a higher-ranked offspring is derived. The 
attention is restricted to Phase 1 only. Analysis on Phase 2 is similar. 

We use the Law of total probability on the probability of failure (F), i.e. the proba- 
bility that a species with higher auxiliary value does not evolve. We have three types 
of pairs that can evolve: < a*,a* >,< a*,(3* >, < a*, 7* >. We define event A that 
none of the three pairs get selected into the pool and event B that at least one of 
any pair gets selected. Since obviously P{F\A) = 1, 

P{F) = P{F\A)P{A) + P{F\B)P{B) = P{A) + P{F\B)P{B) 



If there are c super-elite species in the population, the probability not to select any 

2 A 

<«*,«*> pairs is simply (1 — j^)^ ■ In a similar way, the probability no to select 

any of the other two types of pairs is, respectively, (1 — j^)^ and (1 — ^4^2"''^ )^ using 
the trivial lower bound on the number of (3* parents (> 1). The product of these 
probabilities is 

P(A)<|l-ilVfl-J^Vr, 



c^A cA cA(;^ — c — 1) 




18 



For X — fj,, which is a usual choice, the probabihty of this event becomes upper 
bounded: 

P{A) < e~i 

the number of pairs of each type in the recombination pool is upper-bounded by 
(respectively) mi, 7712,777.3, so the second part of the expression is the probability to 
select p pairs into the recombination pool and flip the bits unsuccessfully, which is 
denoted by ip^.ip'^,'^'^. 



P{F\B)P{B) = Y, 




< 1 



< e 



The front term is 0(1). We take meiX-{(p[, ip2, ip'^} — (p' < 1 — O(^) and obtain 
the upper bound for the exponential term in the first bracket 6 2(4^^-=^) 2n(4M^-c^) a^^j 

Ac Ac 

e 2(4^2 -c) 2n(4M^-c) jn thc second bracket. Asymptotically for n — >■ 00 and — X both 
of these terms converge to 1, so expressions in both brackets are o(l). Following the 
same ideas, the exponential term in the last bracket is 0(1), so the whole expression 
is 

P{F\B)P{B) = 0(1) ■ 0(1) ■ 0(1) • 0(1) = 0(1) 

Combining the results above, we obtain the probability of failing evolution given a 
constant number of super-elite species in the population is 

P(F) < e-t +0(1) (16) 

And, therefore with probability of at least 1 — e^^ + o(l) the population evolves by 
generating a higher-ranked offspring. For c — 1 this probability is roughly 0.1175 



19 



and for c = 6 ^ 0.5276. 



In this Section we have looked at how the evolution of the super-elite species affects 
the evolution of the population. What we want to do next is look at the evolution 
of these species, i.e. determine if there is any limiting (i.e. if the algorithm is run for 
a very long time) distribution to which their number converges. 



7 Approximation of quasi- stationary distribution 
of the number of super-elite species 

In certain areas of sciences, such as epidemiology and the study of computer viruses, 
Markov chain models are being widely applied to understand the propagation and ex- 
tinction of processes, e.g. spread of viral diseases (see |Nas99] ). the distribution of un- 
infected computers in a computer network (see |WM04] ) . etc. One of the best known 
models in this area is Susceptible-Infected-Susceptible (SIS, see |Nas99tlWM04] ). 



which roughly corresponds to the birth-and-death MC we have constructed in Sec- 
tion |5l To the best of our knowledge this is the first application of this approach in 
EA community, although statistical distribution of the first hitting times was ana- 
lyzed in |GKS99j . 

In this Section we find an approximation to the limiting distribution of the num- 
ber of super-elite species in the population. Derivation of the upper bound were 
shown to hold with high probability if S*a = 0(1). For the purpose of this Section 
we relax this requirement and obtain an asymptotic approximation of the stationary 
distribution of the MC, i.e. with 6*a ^ oo and also 6* a = o{fi). 

Markov chain is the same as in Section [5l which is aperiodic, irreducible and time- 
homogeneous. Since the presence of the absorbing state makes the stationary distri- 
bution trivial with the full mass of probability set to state 6*a, we transform the MC 
adding the probability of moving from state 6* a back to state 1 equal to 1, hence 
this distribution is quasi-stationary. In the light of the set-up of the whole model this 
makes sense, since after the improvement in the auxiliary function the new number 
of super-elite species reduces back to 1. 

We now also assume it is reversible (otherwise we need to derive a set of recur- 
rent equations similar to those in Section [5]). Stationary distribution of an MC is 
defined as the limiting proportion of time spent by the stochastic process Xt in a 
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state Sk' 

TTfc = lim P{Xt = Sk) 

From this, using the set of detailed balance equations we can quite easily derive the 
expressions for the stationary distribution: 

Pi,2vri = g2,i7r2 

P2,37r2 = g3,27r3 



PS*a-2,S*a-l''^S"a-2 
7r2 



(lS''a-l,S*a-2^S*a-l 
Pl,2 



(l2,l 



-TV I 



Pl,2P2,3 
TTs = TTi 

Q2A<l3,2 



Pl,2P2,3 ■ ■ ■ Pa*-l,a* TT P^-^'l 

TTa* — TTi = TTl I I 

?2,1?3,2 • • • 9a*, a* -1 0.1,1-1 

and, since tt^* is a probability distribution: 

&*a 
a*=l 

which enables us to find the expression for tti: 

1 

-1 _l_ v^i5*q:-1 T-rm Pi-i,i 

The rest of the article is dedicated to finding asymptotic approximations of these 
stationary distributions and discussion of what they tell us about convergence of 
EA. Wc consider here two cases, one being a slow rate of progress, the other a fast 
rate of progress. All derivations are for Phase 1. Findings for Phase 2 are very 
similar. 

7.1 Slow progress rate (Poisson approximation) 

Derivation of tTq* depends on the ratio ^^y^- This ratio can be written as a product 

Pi-\,i ^ ^(0^1 _ P_ 
s{l)02 I 
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where 9i, 62 do not depends on I. If the approximation above holds, and ^ = p is not 
very large, the following limiting distribution of super-elite species can be derived. 



TTi = TTi = ji = C*e ^ 



for some constant c*. The ratio in the denominator accounts for quasi-stationarity: 
P5*a,i = 1- Therefore, the stationary distribution for a* super-elite species is 



* -p P 

TTa* = C e ^ r 



which is a form of truncated Poisson distribution with removed origin (0) and the 
upper tail {6*a, 6*a + 1, ...). If we allow 6* — )■ oo, c* can be found: 



Eoo 



a* 



7.2 Fast progress rate(Normal approximation) 

Here we consider the limiting distribution of super-elite species as p — )■ oo. We use 
A* as a random variable for super-elite species: 

which, as mentioned before, is a form of truncated Poisson distribution with removed 
origin (for comparison see |Nas96] . Section 3). We use characteristic function to 
derive its expectation and variance: 



a 

a*=l a*=l 



For 5* a — )■ oo. Standardizing constant is c* (to account for removed origin). By 
taking a derivative w.r.t t and setting t = 0: 



EA* = -0'^.(O) 



z ^ ' ' idt 



= TTiC'^p = C*p 

t=0 



i=0 

In a similar way we find asymptotic expression for the variance, VarA*: 
YarA* = EA*^ - (EA*f = -0"(O) + (^'(O))^ 
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This uses the fact that ^ —1 and i = — z. Therefore, 
0"(O) = -7rip(p+ l)e^ (^'(0))2 = -nye'^ 

Hence, 

VarA* = 7rip(p + 1)6" - nlp'^e^" = c*p{l + p(l - c*)) 

Since we now know both expectation and variance of this random variable, we can 
find the hmiting distribution of standardized A*: 

A*-'EA* 

A' 



VVarA* 



Using the the sum of Poisson random variables we get 'EA' — 0, VaiA' — 1. There- 
fore: 



(E^i + EAl + ... BAD _ Al- EAl A* - EA* A* - EA 



P 



^A[ + A', + ...A'^ 

where all A'^ are iid. The characteristic function of A' is 

Mt) = Ee'*^' = Ee**^' = E J[ e''^'^ = {Ee^'^' f = (^1 + itA'i + (^-^^ +o(^ 



which is a characteristic function of standard Normal distribution with parameters 
and 1. The derivation was due to Taylor scries expansion of the exponential 
function around (since the function is dominated by p). Since are all identically 
distributed, their expectation is 0. Additionally, 

EA; < EA* < oo 
^,,,,2 E{A*-EA*y Var^r 1 

So the conditions for the Central Limit Theorem are fulfilled, and super-ehte species 
converge to Normal distribution if the progress rate is high. As it turned out, to 
prove convergence of the transformed truncated Poisson random variable to Normal 
distribution,we did not use its expectation and second moment. 
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8 Summary and conclusions 



The work of the Ehtism Levels Traverse Mechanism is based on identifying the ways 
to add at most one super-ehte offspring to the population. Probabilities from these 
expressions serve as parameters in the birth-and-death MC. For the Royal Roads 
function with fitness plateaus we obtained an upper bound (worst-case analysis) in 
a very general form that is a function of the population ii and recombination pool 
sizes A, length of plateaus M and the number of fitness levels K. For a specific case 
oi M = K = ^Jn a sensible upper bound of was derived that is better 

than O(n^) bound previously known in literature. 

Additionally, we have shown that, as the number of super-elite species increases 
(till f ), so does the probability of adding the super-elite offspring. If the run of the 
algorithm is broken down into two Phases: solution of the first active bin and the 
rest K — \ bins, the runtime of Phase 2 is only by a factor of log n larger than Phase 
1. This confirms the intuition that it takes much longer to solve the bin only when 
a relatively small number of 1-bits is available in the population (early phase) than 
when there are many species with a large number of 1-bits (later phase) . 

Perhaps for the first time in EA community we have attempted to derive the distribu- 
tion of species in the population. Using the MC defined above, we have approximated 
the stationary distribution of super-elite species. We have shown that it converges to 
truncated Poisson distribution if the progress rate is small and Normal if it is large. 
This finding helps better understand the limiting structure of the population. It is 
certainly possible to do so for other subsets thereof, which will certainly contribute 
to a better understanding of how EAs work. 
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A Runtime of Phase 1 

Here we have some of the algebraic derivations from Section |6l most of which were 
done in Matlab and Matlab Symbolic Toolbox. 

The first expression of Phase 1 is 

f^\(2a* 2a*fa-l-a*\ 1 2 ( a - I - a*\ \ 



[Wit06] 

[Wit08] 
[WJ07] 

[WM04] 
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All species in the population have the same fitness, there are no r/ parents. The swap 
probabilities are defined as following: 



<^i = ^(2i^-3 + j) 

2(M+l-j)(2K-3 + i) 
_ {M + l-j){K-Z + j) 



The first expression is due to selecting a 1-bit in the active bin in a* and a 1 anywhere 
in the second parent This uses the pessimistic assumption that in all bins /3* 
parents have only two 1-bits. The second one is the same just the second parent is 
7*. The third is due to selecting a 0-bit in the next-best species and a 1 anywhere 
in the second parent (also next-best species, therefore multiplied by 2). The fourth 
swap probability is selecting a 0-bit in the (3* parent's active bin and 1 anywhere 
from 7*. Therefore, 



= ^^WK - 3 + j) - a*j{K - 3 + j) + (/^ - mK - 3 + j)) 

+ (M + 1 - j) {2{2K - 3 + j) - 2«*(^ - 3 + j) + 2{^i-l){K-2, + j)) 

= ^^{2j{a* -l)(K+{K-3 + - a*) + 2j{pi -l)(K-3 + j){a* + 1))) 

_ 2Xja*{K +{K -3 + j){n + l- a*)) 



A 



The first expression of the expectation of Phase 1 is 




1 o 2 2 1 

1 8fj,^n'' s. - X - 1 




We continue by expanding the summand in partial fractions (w.r.t a*): 



2]a*{K + - 3 + + 1 - «*)) 



2j{K + Kfj. + jn) \a* K + Kfj. + jfi - a*{K + j) 
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Sum over a* of the first fraction is of course log{5*a). The second fraction can be 
approximated in the following way (up to a constant): 

K + j 1 



K + KiJ, + j/jL- a*{K + j) 11- a* 
and the expression becomes 

Sl^ I -flog. 



2j{K + Kii + jiJ,)\ ''ii-S*a^ 
Again, expanding the expression in partial fractions w.r.t. j, we get 



SI log 



II -6* a J \2{K + Kii)j 2{K + Kii){K + Kii + jii) 



Summing the first term w.r.t. j we get Hm ~ log(M + 1). The second term is at 
most 0(1). The upper bound for the first expression is (since ^ 1) 



4//n^log(M + 1) log 



5*afj, 
IJ,—S*a 



XK 

The second expression in Phase 1 is 

i5*a— 1 

d a 



Pl,2 



a*=2 



We simplify the cumbersome term in the denominator in the second expression (as- 
suming ri,i < pi^2 and using Bernoulli inequality): 

S*a S*a S*a ^ 5*a 



pl*a (1 _ (1 _ pi,2))^*° (1 - ri,i)^*" - 1 - 5*api,. 
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The expression for pi 2 can be upper-bounded in the following way: 
X5*a ( 2j(j-l + 2(X-l)) 2(/i - 2)j(i^ - 3 + j) 



+ 



+ 



2(M+l-j)(2K-3 + j) 
2(//-2)(M + l-i )(K-3 + j)' 

X5*a 



^ T^2 I ^'(Si^ + j) + m{2K + j) + (2M - j){2K + j) 



+ fx{2M - j){2K + j) I < -^(2/.j(2K + j) + 2//(2M-j)(2i^ + j) 



4:ij,^n 
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Trivially j < M, so the whole expression becomes (since we have at most M — 3 bits 
to flip: 

^ 5*a 6*a{M - 4) 

,=1 Pl,2 1 ^;^2 ^ 

Thus we have simplifies the front term in the second expression, we now derive the 
rest of it. We pessimistically assume that if the super-elite species degrades, it is 
replaced by its offspring. The only type of pairs in Phase 1 that enable degrading of 
super-elite species is < q;*,7* >. 

_ a*(ii -1-a*) 

J n-{j-2)-{K-l) _j{r>-K + 3-j) 

qfiip 2 

Qflip = 1 - (If lip 

_ Xj{n-K + 3-j) 

— r, 
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5*a-l S*a-1 S*a-1 4 /A- 



a*=2 a*=2 ^ ^ a*=2 1=0 

S*a—1 (5*0—1 

CK'lM — i — a" ) , , 

a*=2 a*=2 

■5*0-1 a*(M-l-a*)Aq^^;.p /.I 3:(M-l)(M-l-(M-l)^)Ag^,.p 

< E ~ <^*'^ / 6 ^^^^ 



(1 - PseiQfUp)' = E (1 i;;^^ ^fl^py 



a* =2 

„2, 







-1 ^^x(l-x)Ag^;.p ,.1 ■r)A,i;).;^p 

< 5*q: / e 33^;^^ (ix = S*a e 3'^ dx 



^0 



The second step is due to Binomial theorem (a + &)"■ = {^^a^h^~^ and the third 
one is the definition of the exponential function: (1 — < e~". Sum is approxi- 
mated using Riemann sums. The last expression is Dawson's integral. For small a, 
which we would expect them to be given that if j < M then a = O(^) Dawson's 
integral can be expanded in Taylor series: 



S*a{ 1--^] <5*a 



Summing over j this becomes 

M-3S*a-l 

E E ^«*,a*-i = S*a(M - 4) 

j=l a*=2 

The second expression is 

S*a(M - 4) {6*a{M-4)f 

'-'2 . XS*aM(2K+M) - ^ Oi{lVI ^) XS*aM{2K+M) ' ) 

J- — 1 J- — 5 

Therefore the expected first hitting time of Phase 1 becomes 

^ W log(M + 1) log ^ ^ (^*c.(M - 4))^ 



' ^ _ \S*aM{2K+M) 



T7- 
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B Runtime of Phase 2 



We present here algebraic derivation for Phase 2. The first expression is very similar 
to that in Phase 1 up to a constant, so we only give the main results. 

The swap probabilities are 

i(A;M + 2K + i-3) 
= 5 

j(kM + K + j-2) 

f2 = 2 

2(M -j + l){kM + 2K + j-3) 

(M-j + l)(A;M + i^ + j-2) 
= ^ 



So Pa*,a*+i can be transformed accordingly: 



Pa*,a*+1 > -^(20; Vl + (yf3 + 4(/U - 1 - Q;*)(q;V2 + (^4)) 



^ {2{kM + 2K + j -3){M +l + j{a* -1) 



+ 4(// - 1 - a*){kM + K + j -2){M+1+ j{a* - 1)))) 

^ (M+l+j(Q;* - 1))(K + (A;M + A; + j -3)(2// + 3-a*)) 



The first expression is 

, 9 9 K M 5*a-l 

^ V^y^y^ 1 

A (M+l + j(a*-l))(X+(^M + A; + j-3)(2;t. + 3-a*)) 

Now for the second expression: 

5*a 1 ^*"^^ 

k j a*=2 
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For the front term we use the same trivial upper bound, now for K: 

^ 5*a{M -A) _ 5*a{M - A){K - 2) 

2-^ _ XS*aM{2K+M) ~~ _ X&*aM{2K+M) 
k=l /w? /w? 

There are two ways to lose a super-elite species now, when pairing it with either 
7* or 77. The probability to select a 0-bit in 7* parent is 

n-{K-l)- k{M -l)-{j-2)_n-K + 3- k{M - 1) - j 
n n 

for 77 it is 

n-{K-l)- (fc- 1)(M- 1) 

n 

which is larger than the one for 7*. The probability to select a 1-bit in the active 
bin in a* parent is always ^. For simplification we do not consider degrading of 
previously-improved bins, which would of course relegate the super-elite parent into 
?7 subset. We get: 



S2 — ?a*,a*-l ~ ( ^ ) PsellQswapl ( ^ ) ^sel2Qswap2 

k j a*=2 ^ ^ ^ ^ 

-1^1^ 1^ ^^seliqswap2 " 2^ 

k j a*=2 ^ k=l 



M-1 . 5*a~-l 
j=3 a*=l 



A M2-M-6 {3^^-2S*a-l)S*a{5*a-l) {K - 2){2n - K - KM + M - 3) 



< 



AiJ?'n? 2 6 2 

A(M2 - M - 6) (3// - 25* a - l){5*aY{K -2){2n-K- KM + M - 3) 



The combined expression for Phase 2 is 

ET^ < ^ ■ ^^^^ log fs + ^l \ iM-A){K-2fX{M^-M-6) 
^ ~ A 25*aK + M y n5*a J _ xs*aM(2K+M) '^ 

{3fi - 26*a - l){6*ay{2n -K- KM + M - 3) 
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C Lower bounds on probabilities of p species in 
Phase 2 



In Section |6] for lower bounds on probabilities for pairs < a* ,r] > and < (3*,r] > 
in Phase 2 derivation we used values for< a*, 7* > and < /3*,7* >. We show here 
more rigorously for what values this bound is correct. We compare the following 
expressions: 



a*{fi - 1 - a* 
IJ V 



The swap probability tp^ > since we need to select a in a* active bin and a 
in the second parent, and obviously there are more 0-bits in rj than in 7* and terms 
and ^ cancel out. What remains to show is for what a > a* 

(/i - > (/i - 1 - a*) 

This is quadratic inequality in a, so we express it as (set //^ + + fia* = t): 

2o? - + t > 
Since t > 0, 4/i > and < 2 < ^^^2^^^^^^,^ the only sensible solution is 



4a^- y/S^ 4/x- v/l6/x2-4-2-(;u2 + //+7Itf^ 
1 < a < : < : !=a .29u 

- 4 - 4 

So for 1 < a < .29/i the inequality holds: 

P(< a*,r/ >) > P(< a*, 7* >) 

At the same time, 



P(< /3*,7* >) = 



^ Y-ifi-l-a*){M-j + l){kM + J - 2) 
1 J 4/^2 n2 

l\l.{^-a)^M-j-l)K 



2/^3 n' 



2 
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Since ip^ < ip4 in this case (it is more likely to sample a 1-bit from 7* rather than 
rj, we need to account for these values too (note we take an extreme lower bound on 
the probability of sampling a 1-bit from 77, ^). Canceling out terms, we obtain, like 
before a quadratic inequality in a: 

mo? - UiiKa + n{kM + j - 2){1 + a* - fj,) + 6f/K > 

solving this, as before, there exists only one sensible solution: 



kM + j-2 V K 

I < a < jjL 1=\ — < A* - 



M(fcM+j-2)(M-a*-l) 



by taking k — K,j — M — Hi seems that the worst upper bound on a is 



M 3 , 

l<a<Ml-.4-^/M+ — --) 



which is valid for 



. , M 3 ^ _ M - 3 
1-.4-WM+ — - — >0<^X> 



K K - 6.25 - M 

that is, only small M < 6, i.e. for problems with small bins similar or marginally 
more complicated than OneMax. Most rj parents have more than K 1-bits, but we 
neither make assumptions about their distribution, nor track the change in their 
number (unlike a*). If, instead we assume that the number is \fMK, the bounds 
become vahd till M < 39. We will keep investigating ways of making this approach 
more general. 
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